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Abstract. Motivated by the Hadamard product of matrices we define the 
Hadamard product of multivariate polynomials and study its arithmetic circuit 
and branching program complexity. We also give applications and connections to 
polynomial identity testing. Our main results are the following. 

• We show that noncommutative polynomial identity testing for algebraic 
branching programs over rationals is complete for the logspace counting 
class CLL, and over fields of characteristic p the problem is in Mod p L/poly. 

• We show an exponential lower bound for expressing the Raz-Yehudayoff 
polynomial as the Hadamard product of two monotone multilinear polyno- 
mials. In contrast the Permanent can be expressed as the Hadamard product 
of two monotone multilinear formulas of quadratic size. 



1 Introduction 

In this paper we define the Hadamard product of two polynomials / and g in ¥(X ) and 
study its expressive power and applications to the complexity of arithmetic circuits and 
algebraic branching programs. We also apply it to give a fairly tight characterization of 
polynomial identity testing for algebraic branching programs over the field of rationals. 

Suppose X = {xi , X2, • • • , x„} is a set of n noncommuting variables. The free monoid 
X* consists of all words over these variables. For a field F let F(xi , X2, • • ■ , x n ) denote 
the free noncommutative polynomial ring over F generated by the variables in X. Thus, 
the polynomials in this ring are F-linear combinations of words over X. For a given 
polynomial / G ¥(X), let mon(/) = {rn G X* | m is a nonzero monomial in /}. 
If X = {xi, X2, • ■ • , x n } is a set of n commuting variables then ¥[X] denotes the 
commutative polynomial ring with coefficients from F. 

Motivated by the well-known Hadamard product of matrices (see e.g. |Bh97|) we define 
the Hadamard product of polynomials. 



Definition 1. Let f,g£ ¥(X) where X = {xi, X2, ■ • • , x n }. The Hadamard product 

off and g, denoted fog, is the polynomial f°g = ^2 m where f — Yl,m a m TO 

and g = ^ m b m m, where the sums index over monomials m. 



Complexity theory preliminaries We recall some definitions of logspace counting 
classes from |A096|. Let L denote the class of languages accepted by deterministic 
logspace machines. 

GapL is the class of functions / : U* — » Z, for which there is a logspace bounded 
NDTM M such that for each input x £ £*, we have f(x) = ciccm(x) — rej M {x), 
where accu (%) and rej M (x) are the number of accepting and rejecting paths of M on 
input x, respectively. 

A language L is in C = L if there exists a function / £ GapL such that x £ L if and 
only if f(x) = 0. For a prime p, a language L is in the complexity class Mod p L if there 
exists a function / £ GapL such that x £ L if and only if f(x) — 0(modp). 

It is shown in [A096] that checking if an integer matrix is singular is complete for 
C = L with respect to logspace many-one reductions. The same problem is known to be 
complete for Mod p L over a field of characteristic p. It is useful to recall that both C = L 
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and ModpL are contained in TC (which, in turn, is contained in NC ). 

An Algebraic Branching Program (ABP) |N91 RS05] over a field F and variables 
xi,X2, - ■ ■ , x n is a layered directed acyclic graph with one source vertex of indegree 
zero and one sink vertex of outdegree zero. Let the layers be numbered 0, 1, • • • , d. The 
source and sink are the unique layer and layer d vertices, respectively. Edges only go 
from layer i to i + 1 for each i. Each edge in the ABP is labeled with a linear form over 
F in the input variables. Each source to sink path in the ABP computes the product of 
the linear forms labelling the edges on the path, and the sum of these polynomials over 
all source to sink paths is the polynomial computed by the ABP. The size of the ABP is 
the number of vertices. 

Main results. We show that the noncommutative branching program complexity of the 
Hadamard product fog is upper bounded by the product of the branching program sizes 
for / and g.This upper bound is natural because we know from Nisan's seminal work 
|N91 1 that the algebraic branching program (ABP) complexity B(f) is well character- 
ized by the ranks of its "communication" matrices Mfe(/), and the rank of Hadamard 
product A o B of two matrices A and B is upper bounded by the product of their ranks. 
Our proof is constructive: we give a deterministic logspace algorithm for computing an 
ABP for fog. 

We then apply this result to polynomial identity testing. It is shown by Raz and Sh- 
pilka |RS05 1 that polynomial identity testing of noncommutative ABPs can be done in 
deterministic polynomial time. A simple divide and conquer algorithm can be easily 
designed to show that the problem is in deterministic NC 3 . What then is the precise 
complexity of polynomial identity testing for noncommutative ABPs? For noncommu- 
tative ABPs over rationals we give a tight characterization by showing that the problem 
is C = L-complete. We prove this result using the result on Hadamard product of ABPs 
explained above. 
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For noncommutative ABPs over a finite field of characteristic p, we show that identity 
testing is in the nonuniform class Mod p L / poly (more precisely, in randomized Mod p L). 
Furthermore, the problem turns out to be hard (w.r.t. logspace many-one reductions) for 
both NL and Mod p L. Hence, it is not likely to be easy to improve this upper bound 
unconditionally to Mod p L (it would imply that NL is contained in Mod p L). However, 
under a hardness assumption we can apply standard arguments [ARZ99 KvM02) to 
derandomize this algorithm and put the problem in Mod p L. 

In Section|4]we consider the Hadamard product for commutative polynomials. We show 
an exponential lower bound for expressing the Raz-Yehudayoff polynomial [RY08 1 as 
the Hadamard product of two monotone multilinear polynomials. In contrast the Perma- 
nent can be expressed as the Hadamard product of two monotone multilinear formulas 
of quadratic size. 



2 The Hadamard Product 



Let f,g £ ¥(X) where X = {xi,X2,--- ,x n }. Clearly, mon(/ o g) = mon(/) n 
mon(g). Thus, the Hadamard product can be seen as an algebraic version of the inter- 
section of formal languages. Our definition of the Hadamard product of polynomials is 
actually motivated by the well-known Hadamard product A o B of two m X n matri- 
ces A and B. We recall the following well-known bound for the rank of the Hadamard 
product. 

Proposition 1. Let A and B be m x n matrices over afield F. Then rank(yl o B) < 
rank(A)rank(B). 

It is known from Nisan's work JN91I that the ABP complexity B(f) of a polynomial 
/ £ ¥(X) is closely connected with the ranks of the communication matrices Mk(f), 
where Mk(f) has its rows indexed by degree k monomials and columns by degree 
d — k monomials and the (m, m!) th entry of Mk(f) is the coefficient of mm' in /. 
Nisan showed that B(f) = 5D fc rank(Affc(/)). Indeed, Nisan's result and the above 
proposition easily imply the following bound on the ABP complexity of / o g. 

Lemma 1. For f, g £ ¥(X) we have B(f o g) < B(f)B(g). 

Proof. By Nisan's result B(f o g) = ^ fc rank(Affc(/ o g)). The above proposition 
implies 

^rank(A4(/o. 9 )) < £ rank(M fc (/))rank(A/ fc ( 5 )) < (^rank(Af fe (/))(^rank(Af fc ( 3 ))), 
and the claim follows. ■ 
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We now show an algorithmic version of this upper bound. 

Theorem 1. Let P and Q be two given ABP's computing polynomials f and g in 
F(xi,a;2, . . . , x n ), respectively. Then there is a deterministic polynomial-time algo- 
rithm that will output an ABP R for the polynomial fog such that the size of R is 
a constant multiple of the product of the sizes of P and Q. (Indeed, R can be computed 
in deterministic logspace.) 

Proof. Let fi and denote the i th homogeneous parts of / and g respectively. Then 
/ = J2i=o fi an d 9 — X)f=o 9i- Si nce the Hadamard product is distributive over addi- 
tion and fi o gj = for i ^ j we have fog — J2i=o /» ° 9i- Thus, we can assume that 
both P and Q are homogeneous ABP's of degree d. Otherwise, we can easily construct 
an ABP to compute f o gi separately for each i and put them together. Note that we can 
easily compute ABPs for fi and gi in logspace given as input the ABPs for / and g. 

By allowing parallel edges between nodes of P and Q we can assume that the labels 
associated with each edge in an ABP is either or axi for some variable Xi and scalar 
a E F. Let Si and s 2 bound the number of nodes in each layer of P and Q respectively. 
Denote the j th node in layer i by for ABPs P and Q. Now we describe the 
construction of the ABP R for computing the polynomial / o g. Each layer i, 1 < i < d 
of R will have s\ ■ s 2 nodes, with node labeled (i, a, b) corresponding to the node (i, a) 
of P and the node (i, b) of Q. We can assume there is an edge from every node in layer 
i to every node in layer i + 1 for both ABPs. For, if there is no such edge we can always 
include it with label 0. 

In the new ABP R we put an edge from (i, a, b) to (i + 1, c, e) with label a(3x t if 
and only if there is an edge from node (i,a) to (i + 1, c) with label ax t in P and an 
edge from (i, b) to (i + 1, e) with label /3x t in ABP Q. Let (0, a, b) and (d, c, e) denote 
the source and the sink nodes of ABP R, where (0, a), (0, b) are the source nodes of 
P and Q, and (d, c), (d, e) are the sink nodes of P and Q respectively. It is easy to 
see that ABP R can be computed in deterministic logspace. Let /i(i, a ,6) denote the 
polynomial computed at node (i, a, b) of ABP R. Similarly, let fn^ a \ and guM denote 
the polynomials computed at node (i, a) of P and node (i, b) of Q. We can easily check 
that ft(i, ,6) = f(i, a ) ° 9{i,b) by an induction argument on the number of layers in the 
ABPs. It follows from this inductive argument that the ABP R computes the polynomial 
/ o g at its sink node. The bound on the size of R also follows easily. ■ 

Applying the above theorem we can give a tight complexity theoretic upper bound for 
identity testing of noncommutative ABPs overrationals. 

Theorem 2. The problem of polynomial identity testing for noncommutative algebraic 
branching programs over Q is in NC 2 . More precisely, it complete for the logspace 
counting class C = L under logspace reductions. 
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Proof. Let P be the given ABP computing / € Q(X). We apply the construction of 
Theorem[T]to compute a polynomial sized ABP R for the Hadamard product / o / (i.e. 
of / with itself). Notice that / o / is nonzero iff / is nonzero. Now, we crucially use the 
fact that / o / is a polynomial whose nonzero coefficients are all positive. Hence, / o / 
is nonzero iff it evaluates to nonzero on the all l's input. The problem thus boils down 
to checking if R evaluates to nonzero on the all l's input. 

By TheoremQ] the ABP R for polynomial fof is computable in deterministic logspace, 
given as input an ABP for /. Furthermore, evaluating the ABP R on the all l's input 
can be easily converted to iterated integer matrix multiplication (one matrix for each 
layer of the ABP), and checking if R evaluates to nonzero can be done by checking if 
a specific entry of the product matrix is nonzero. It is well known that checking if a 
specific entry of an iterated integer matrix product is zero is in the logspace counting 
class C = L (e.g. see BAQ96IABQ99I ). However, C = L is contained in NC 2 , in fact in 
TC 1 . 

We now argue the hardness of this problem for C = L. The problem of checking if an 
integer matrix A is singular is well known to be complete for C = L under deterministic 
logspace reductions. The standard GapL algorithm for computing det(A) BT911 can be 
converted to an ABP Pa which will compute det(A)Q Hence the ABP Pa computes 
the identically zero polynomial iff A is singular. Putting it all together, it follows that 
identity testing of noncommutative ABPs over rationals is complete for the class C = L. 



An iterative matrix product problem Suppose B is a noncommutative ABP com- 
puting a homogeneous polynomial in ¥(X) of degree d, where each edge of the ABP 
is labeled by a homogeneous linear form in variables from X. 

Let ng denote the number of nodes of B in layer £, < £ < d. For each Xi and layer 
I, we associate an ni x ng + i matrix Aij where the (k,j) th entry of matrix A^i is the 
coefficient of Xi in the linear form associated with the (vk , Uj ) edge in the ABP B. Here 
Vk is the k th node in layer £ and Uj the j th node in the layer £ + 1. The following claim 
is easy to see and relates these matrices to the ABP B. 

Claim. The coefficient of any degree d monomial Xi x Xi 2 ■ ■ ■ Xi d in the polynomial com- 
puted by the ABP B is the matrix product Ai Xt oAi 2t i ■ ■ ■ Ai d ^~i (which is a scalar since 
A ix o is a row and A id ^-i is a column). 

Let i and j be any two nodes in the ABP B. We denote by B(i,j) the algebraic branch- 
ing program obtained from the ABP B by designating node i in B as the source node 
and node j as the sink node. Clearly, B(i,j) computes a homogeneous polynomial of 
degree b — a if i appears in layer a and j in layer b. 

1 Notice that the polynomial computed by the ABP Pa is a constant since Pa has only constants 
and no variables. 
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For layers a, b, < a < b < d let t = b — a and P(a, b) = 
{A Sua A S2>a+ i . . . A St ,6_i|l < sj < n, fori < j < t}. P(a,b) consists of n a x n b 
matrices. Thus the dimension of the linear space spanned by P(a, b) is bounded by 
n a rib. It follows from Claim [2] that the linear span of P(a, b) is the zero space iff the 
polynomial computed by ABP B(i,j) is identically zero for every 1 < i < n a and 
1 < j < n b . 

Thus, it suffices to compute a basis for the space spanned by matrices in P(0,d) to 
check whether the polynomial computed by B is identically zero. We can easily give a 
deterministic NC 3 algorithm for this problem over any field F: First recursively compute 
bases Mi and M2 for the space spanned by matrices in P(0, d/2) and P(d/2 + 1, d) 
respectively. From bases M\ and Mi we can compute in deterministic NC 2 a basis M 
for space spanned by matrices in P(0, d) as follows. We compute the set S of pairwise 
products of matrices in Mi and M2 and then we can compute a maximal linearly inde- 
pendent subset of S in NC 2 (see e.g. [AB099|). This gives an easy NC 3 algorithm to 
compute a basis for the linear span of P(0, d). This proves the following. 

Proposition 2. The problem of polynomial identity testing for noncommutative alge- 
braic branching programs over any field ( in particular, finite fields ¥) is in deterministic 
NC 3 . 



Can we give a tight complexity characterization for identity testing of noncommutative 
ABPs over finite fields? We show that the problem is in nonuniform Mod p L and is hard 
for ModpL under logspace reductions. Furthermore, the problem is hard for NL. Hence, 
it appears difficult to improve the upper bound to uniform Mod p L (as NL is not known 
to be contained in uniform Mod„L). 



Theorem 3. The problem of polynomial identity testing for noncommutative algebraic 
branching programs over a finite field F of characteristic p is in Mod p L/poly. 

Proof. Consider a new ABP B' in which we replace the variables Xi, 1 < i < n 
appearing in the linear form associated with an edge from some node in layer I to a 
node in layer I + 1 of ABP B by new variable Xij, for layers I — 0, 1, . . . , d — 1. 
Let g G W[X] denotes the polynomial computed by ABP B' in commuting variables 
1 < i < n, 1 < I < d. It is easy to see that the commutative polynomial g £ ¥[X) 
is identically zero iff the noncommutative polynomial / £ ¥{X) computed by ABP B 
is identically zero. Now, we can apply the standard Schwartz -Zippel lemma to check 
if g is identically zero by substituting random values for the variables Xij from F (or 
a suitable finite extension of F). After substitution of field elements, we are left with 
an iterated matrix product over a field of characteristic p which can be done in Mod p L. 
This gives us a randomized Mod p L algorithm. By standard amplification it follows that 
the problem is in Mod p L/poly. ■ 
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Next we show that identity testing noncommutative ABPs over any field is hard for NL 
by a reduction from directed graph reachability. Let (G, s, t) be a reachability instance. 
Without loss of generality, we assume that G is a layered directed acyclic graph. The 
graph G defines an ABP with source s and sink t as follows: label each edge e in G 
with a distinct variable x e and for each absent edge put the label 0. The polynomial 
computed by the ABP is nonzero if and only if there is a directed s-t path in G. 

Theorem 4. The problem of polynomial identity testing for noncommutative algebraic 
branching programs over any field is hard for NL. 



3 Hadamard product of noncommutative circuits 

Analogous to Theorem Q] we show that fog has small circuits if / has a small circuit 
and g has a small ABP. 

Theorem 5. Let f,h£ ¥(x\, x%, ■ ■ • , x n ) be given by a degree d circuit C and a 
degree dABP P respectively, where d — 0{n°^ ). Then we can compute in polynomial 
time a circuit C' that computes f oh where the size of C' is polynomially bounded in 
the sizes of C and P. 

Proof. As in the proof of Theorem[T]we can assume that both / and h are homogeneous 
polynomials of degree d. Let f g denote the polynomial computed at gate g of circuit C. 
Let w bound the number of nodes in any layer of P. Let (i, a) denote the a th node in 
the i th layer of P for < i < d,l < a < w. Let ^(»,o),y,6) denote the polynomial 
computed by ABP P' , where P' is same as P but with source node (i, a) and sink node 
(J, b). We now describe the circuit C" computing the polynomial / o h. In C' we have 
gates (g, I, (i, a), (i + I, b)) for < I < d, < i < d, 1 < a,b < w associated with 
each gate g of C, such that at the gate {g,l,(i,a),(i + l,b)) the circuit C' computes 

r (ta),(*+l;b) = Ha, I) ° h (i,a),{i+l,b) (!) 
where fujs denotes the degree / homogeneous component of the polynomial f g . 

If g is a + gate of C with input gates 51,^2 so that f g = f gi + f g2 , we have 
r {3,l) _ (3i,0 , <<m,0 for < / < < ? < 1 < 

a, b < w. In other words, (g, I, (i, a), (i + I, b)) is a + gate in C' with input gates 
(gi,l, (i, a), (i + I, b)) and (52, 1, (i, a), {i + I, b)). If g is a x gate in C we will have 

/ w 

Jg.l) _VVr <fflJ> r (32,l-j) m 

' (i,a),(i+l,b) — Z^Z^'(i,a),{i+j,t) r {i+j,t),(i+l,b) W 
j=0 t=l 

The above formula is easily computable by a small subcircuit. The output gate of C' 
will be (g, d, (0, 1), (d, 1)), where g is the output gate of C, and (0, 1) and (d, 1) are 
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the source and the sink of the ABP P respectively. This is the description of the circuit 
C. We inductively argue that gate (g, I, (i, a), (i + l,b)) of C" computes the polynomial 
/<s,0 ^(i,a),(i+l,b)' If 5 i s a + g ate °f C the claim is obvious. Suppose g is a x gate of 
C with inputs gi , gi such that f g — f gi ■ f g2 . Inductively assume that the claim holds 
for the gates g 1 and g 2 . Then we have f M = £\ =0 f {gui) ■ f{ g2 ,i-i). Hence, it easily 
follows that 

i 

f(g,l) ° fyt,a),(<+J,b) = ^2(f(gi,j) ■ f(g 2 ,l-j) ° fyi,a),(t+i,6)) 
3=0 

I W 

= X X Asi ,i> ' /(92,i-J> ° tyt,a),(t+j,t) • 
j=0 4=1 
Z it) 

= X/X/^<91J) ° ft (i,«),(i+J,t)) ' (f{92,l-j) ° h(i+j,t),{i+l,b)) 
1=0 *=1 

By induction hypothesis we have r^^^.^ = f {guj) o fe(j, ),(i+j,t) and 

T fi+^,(i+i,6) = f(g3,l-j) ° h (i+j,t),(i+l,b)- Now , from Equation|2]it is easy to obtain 
the desired Equation[T] Therefore, at the output gate (5, d, (0, 1), (d, 1)) the circuit C" 
computes f oh. The size of C is bounded by a polynomial in the sizes of C and P. 



On the other hand, suppose / and g individually have small circuit complexity. Does 
fog have small circuit complexity? Can we compute such a circuit for fog from 
circuits for / and gl We first consider these questions for monotone circuits. It is useful 
to understand the connection between monotone noncommutative circuits and context- 
free grammars. We recall the following definition. 

Definition 2. We call a context-free grammar G = {V, T, P, S) an acyclic CFG if for 
any nonterminal A G V there does not exist any derivation of the form A uAw, 
and for each production A (3 we have \[3\ < 2. 

The size size(G) of an acyclic CFG G = (V, T, P, S) is defined as \V\ + |T| +size(P), 
where V, T, and P are the sets of variables, terminals, and production rules. We note 
the following easy proposition that relates acyclic CFGs to monotone noncommutative 
circuits over X. Proof of the Proposition's in the Appendix. 

Proposition 3. Let C be a monotone circuit of size s computing a polynomial f G 
<Q(X). Then there is an acyclic CFG G for mon{f) with size(G) = O(s). Conversely, 
ifG is an acyclic CFG of size s computing some finite set L G X* of monomials over X, 
there exists a monotone circuit of size 0(s) that computes a polynomial X) TO gL a m TO G 
Q{X), where the positive integer a rn is the number of derivation trees for m in the 
grammar G. 
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Theorem 6. There are monotone circuits C and C computing polynomials f and g in 
Q(-X") respectively, such that the polynomial fog requires monotone circuits of size 
exponential in \X\, size(C), and size(C'). 

Proof. Let X = {xi, ■ ■ ■ ,x n }. Define the finite language L\ = {zww r \ z,w € 
X*, \z\ — \w\ = n} and the corresponding polynomial / = Yl m eL ± m «' Similarly 
let L2 — {ww r z I z, w G X*, |z| = |u>| = n}, and the corresponding polynomial 

g = Ylm el 2 TOq - ft ' s eas y t0 see tnat tnere are P°ly( n ) srze unambiguous acyclic 
CFGs for Li and L^- Hence, by Proposition[3]there are monotone circuits C\ and G2 of 
size poly(n) such that C\ computes polynomial / and C2 computes polynomial g. We 
first show that the finite language L\ fl cannot be generated by any acyclic CFG of 
size 2 o(nlgn) . Assume to the contrary that there is an acyclic CFG G = (V, T, P, S) for 
L 1 DL 2 of size 2 o( - n ^ n K Notice that L x n X 2 = {i | * = ™ r !«,io £ X*, |to| = n}. 

Consider any derivation tree T' for a word ww r w = 
W\W2 ■ ■ ■ w n w n w n -i . . . W2W1W1 . . . w n . Starting from the root of the binary 
tree T', we traverse down the tree always picking the child with larger yield. Clearly, 
there must be a nonterminal A G V in this path of the derivation tree such that A =>* u, 
u 6 X* and n < \u\ < In. Crucially, note that any word that A generates must 
have same length since every word generated by the grammar G is in L\ n L2 and 
hence of length 3n. Let ww r w — S1US2 where | s 1 1 = k. As \u\ < 2n, the string SiS 2 
completely determines the string ww r w. Hence, the nonterminal A can derive at most 
one string u. Furthermore, this string u can occur in at most 2ri positions in a string of 
length 3n. Notice that for each position in which u can occur it completely determines 
a string of the form ww r w. Therefore, A can participate in the derivation of at most 2n 
strings from L\ n £2- Since there are n n distinct words in L\ n L2, it follows that there 
must be at least S- distinct nonterminals in V. This contradicts the size assumption of 
G. 

Since L\ n L2 cannot be generated by any acyclic CFG of size 2°( nlog ™', it follows 
from Lemma[3]that the polynomial fog can not be computed by any monotone circuit 
of 2°(™ lo s™) size. ' ■ 



Theorem[6] shows that the Hadamard product of monotone circuits is more expressive 
than monotone circuits. It raises the question whether the permanent polynomial can be 
expressed as the Hadamard product of polynomial-size (or even subexponential size) 
monotone circuits. We note here that the permanent can be easily expressed as the 
Hadamard product of 0(n 3 ) many monotone circuits (in fact, monotone ABPs). 

Theorem 7. Suppose there is a deterministic subexponential-time algorithm that takes 
two circuits as input, computing polynomials f and g in Q(xi, • • ■ , x n ), and outputs a 
circuit for f o g. Then either NEXP is not in P/poly or the Permanent does not have 
polynomial size noncommutative circuits. 
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Proof. Let C\ be a circuit computing some polynomial h € Q(xi, . . . , x n ). By as- 
sumption, we can compute a circuit C2 for h o h in subexponential time. Therefore, h 
is identically zero iff h o ft is identically zero iff C2 evaluates to on the all l's input. 
We can easily check if C2 evaluates to on all l's input by substitution and evaluation. 
This gives a deterministic subexponential time algorithm for testing if h is identically 
zero. By the noncommutative analogue of | KI03 1, shown in [ AMS08 1, it follows that ei- 
ther NEXP <f_ P/poly or the Permanent does not have polynomial size noncommutative 
circuits. ■ 



Next, We show that the identity testing problem: given /, g S ¥(X) by circuits test if 
/ o g is identically zero is coNP hard. The proof of Theorem[8]is given in the Appendix. 

Theorem 8. Given two monotone polynomial-degree circuits C and C computing 
polynomial f,g£ Q(X) it is coNP- complete to check if f o g is identically zero. 



4 Hadamard product of monotone multilinear circuits 

In this section we study the Hadamard product of commutative polynomials (defined as 
in the noncommutative case). First we introduce some notation useful for this section. 
Given a polynomial / G F [X] , and a monomial m over the variables X, we define / (m) 
to be the coefficient of the monomial m in the polynomial /@ Recall the Definition Q]of 
the Hadamard product of two polynomials in ¥(X). We define the Hadamard product in 
the commutative case analogously. Thus, for polynomials f,g£ ¥[X] we have F(m) = 
f(m)g(m) for any monomial m, where F = f o g. 

In this section our interest is the expressive power of the Hadamard product. Can we 
express a hard explicit polynomial (like the Permanent) as the Hadamard product fog 
where / and g have small arithmetic circuits? It turns out that we easily can. 

Proposition 4. There are multilinear polynomials f,g € ¥[xn, X12, ■ ■ • ,x nn ] such 
that both f and g have arithmetic formulas of size 0(n 2 ) and fog is the Permanent 
polynomial. Furthermore, for ¥ = Q these formulas for f and g are monotone. 

Proof. Define the polynomials / and g on the variables {xij | 1 < i, j < n} as follows 
/ = n"=i(Sj=i x ij) and 9 = lYj=i(J2i=i x ij)- Clearly, their Hadamard product is 
Perm(xu , x nn ). The formulas for / and g over rationals are monotone. ■ 

Nevertheless, we will define an explicit monotone multilinear polynomial that cannot 
be written as the Hadamard product of multilinear polynomials computed by subexpo- 
nential sized monotone arithmetic circuits. Our construction adapts a result of Raz and 

2 There should be no confusion with evaluating the multivariate polynomial / at a point 

(01, • • • , a„) as we denote that by /(ai, 02, • • • , On). 
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Yehudayoff |RY08| describing an explicit monotone polynomial that has no monotone 
arithmetic circuits of size 2 e ™, for some constant e > 0. Our proof closely follows the 
arguments in |RY08|. Due to lack of space, we provide only proof sketches for several 
technical statements. 

Definition 3. For e > 0, a multilinear polynomial f G C[aci, . . . , x n ] is an e-product 
polynomial if there are disjoint sets A, B C X = {x\, . . . , x n } such that \ A\ > en and 
\B\ > en and f = gh where g G C[A] and h G C[B]. 

In the sequel, we often identify a multilinear polynomial / in C[X] with its coefficients 
vector (indexed by monomials in the natural lexicographic order). The complex inner 
product of vectors w, w' G C k is (w,w') — Yli w i w 'i- Let A4(X) denote the set of 
multilinear monomials over the variables in X. 

Definition 4. The correlation of multilinear polynomials f and g in C[X] is defined as 
Con (f,g) = | EmeA-i(x) f( m )g( m )\- Notice that Corr (/, /) is the £ 2 -norm ||/|| of 



The explicit polynomial from |RY08| The explicit polynomial F we define is essen- 
tially the same as the one in [RY08] (the difference is in the constants). Let s G N be 
a constant, to be chosen later and t = 40s. Let n = tp = 40sp, for a prime p, and 
X = {x\, . . . , x n }. Partition X into t many sets of variables X(l), . . . , X(t) with p 
variables each, where X(i) — {x^i^ p+ j \ j G [p]}. 

In poly (n) time we can construct the field F = ¥ 2 p which is in bijective correspondence 
with {0, 1} P . We can assume that G F is associated with the all 0s vector P . Fix a 
nontrivial additive character ip of F. Since char(F) = 2 we have ip(x) = ±1 for all 
x G F. Each monomial m G A4(X) defines a subset A m of X and is thus represented 
by its characteristic vector w G {0, 1}™. Split w into t blocks wi,. . . ,w t of size p 
each (wi is the characteristic vector of A m n X(i)), and consider the p field elements 
?/i (m), j/2 (w), . . . , yt(m) G F associated with these strings. The bijection between F 
and {0, 1} P implies for any m G M(X) that yi(m) = iff no variable x G X(i) 
appears in m. 

Let us now define the polynomial F. Given a monomial m G M(X), we define F(m) 
to be "0(111=1 Di( m ))- We define a polynomial / G ¥[X] to be explicit if the coefficient 
/(m) of any monomial m can be computed in time polynomial in n. Note that the 
polynomial F is explicit. 

We now state our main correlation result using which we will obtain the lower bound 
against the Hadamard product of monotone multilinear polynomials in C[xi, . . . , x n ], 
A proof sketch is given in the appendix. 
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Lemma 2. Let F £ C[x±, . . . , x n ] be the explicit multilinear polynomial defined above 
and fx, f 2 £ C[x±, . . . , x n ] be any 1/3-product polynomials. Then 



L Y,meM({x u ...,x n }) F ( m ) > 0- 

2. Corr (F, /i o / 2 ) < 2~ an \\F\\\\fi o f 2 \\, for a constant a > that is independent 
of fi and f 2 . 



Using the above lemma bounding the correlation between F and the Hadamard product 
of 1/3-product polynomials, we will prove the main lower bound. We first recall a 
crucial lemma of Raz and Yehudayoff [RY08]. 



Lemma 3. For n > 3, let F £ C[xi, . . . , x n ] be a monotone multilinear polynomial 
computed by a monotone circuit of size s (i.e. the circuit has at most s edges). Then, 
there are s + 1 monotone 1/3-product polynomials /i, /a, • • • , fs+i such that F = 

Es+l r 
i=l Ji- 



Theorem 9. For large enough n £ N, there is an explicit monotone multilinear polyno- 
mial F' G Q[xi , . • • , x n ] that cannot be written as a Hadamard product of two mono- 
tone multilinear polynomials fx, f 2 G R[xi, . . . , x n ] such that each fi is computed by 
monotone circuits of size less than 2 Q ™, where a > is an absolute constant. 



Proof. By the density of primes it suffices to consider n of the form tp, for prime 
p, where t is the constant in the definition of F. Let X denote the set of variables 
{xx, • ■ ■ , Xn}, and let F be the explicit polynomial mentioned in Lemma [2] above. For 
any monomial m G M(X), let F'(m) = (F(m) + 1)/2. Clearly, the coefficients of F' 
all lie in {0, 1}. Consider the correlation between F and F'\ 



E 



i 



> 2 



n-l 



Corr (F, F') = 

m:F(m) — l 

where the inequality above follows from the point 1 of Lemma|2] 

Let us assume that F 1 can be written as fx o f 2 , where fx and fa are multilinear polyno- 
mials computed by monotone arithmetic circuits of size at most s. We assume n > 3, 
so that Lemma[3]is applicable. By Lemma|3] there exist monotone 1 / 3-product polyno- 
mials fx,x, • ■ ■ , /v+i, /2,i, ■ • • , /2, s +i such that f = Y,jt{ fi,j> for each * e {!) 2 I- 
Thus, we have, 



F' 




l<j,k<s+l 



Taking correlation with F on both sides, we see that, 

2"- 1 < Corr(FJ ld of 2ik )< ^ 2-^||F|| \\fx tj o f 2 , k \\, 

l<j,k<s+l l<j,k<s+l 
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by applying triangle inequality and then part 2 of Lemma [2] where (3 > is some 
constant. 

Since, fij o /a,fe's are monotone polynomials adding up to F', it follows that for any 
monomial m € .M(X) its coefficient in f±j o / 2 .fc is at most 1. Hence, H/ij o / 2 ,fc || < 
||F|| and we have 

2- 1 < Ei< M .< s+ i 2^"||F|| 2 = ( S + 1) 2 2«^» 
Consequently, we have s > 2 1311 / 4 , for large enough n. ■ 
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Appendix 



Proof of Proposition [3] 

First we prove the forward direction by constructing an acyclic CFG G = (V, T, P, S) 
for mon(/). Let V = {A g \ g is a gate of circuit C} be the set of nonterminals of G. 
We include a production in P for each gate of the circuit C. If g is an input gate with 
input Xi , 1 < i < n include the production Ag — > Xi in P. If the input is a nonzero 
field element then add the production A g — > eO / g be the polynomial computed at gate 
g of C. If 5 is a x gate with f g = //, x /j. then include the production A g — > A^A^ 
and if it is + gate with / 9 = //, + include the productions A g ^ A^ \ A/.. Let 
the start symbol £> = A 9 , where g is the output gate of C. It is easy to see from the 
above construction that G is acyclic moreover size(G) — O(s) and it generates the 
finite language mon(/). The converse direction is similar. 

Proof of Theorem! 

We first show that the complement of the problem is in NP. The NP machine will guess 
a monomial m a 6 X*, X = {x±, . . . , x n } and check if coefficient of m a is nonzero in 
both C and C . Note that we can compute coefficient of m a in C and C in deterministic 
polynomial time using result from [ AMS08 1. Denote by CFGINT the problem of testing 
emptiness of the intersection of two acyclic CFGs that generate poly(n) length strings. 
By Lemma|3]CFGINT is polynomial time many-one reducible to testing if / o g is iden- 
tically zero. The problem of testing if the intersection of two CFGs (with recursion) is 
empty is known to be undecidable via a reduction from the Post Correspondence prob- 
lem [HMU, Chapter 9, Page 422]. We can give an analogous reduction from bounded 
Post Correspondence to CFGINT. The coNP-hardness of CFGINT follows from the 
coNP-hardness of bounded Post Correspondence IGJ79I . 



Proof of Lemma |2] 

Part 1 of Lemma |2] is trivial. By construction, each of the coefficients of F is ±1. For 
any z £ F note that J2 y ew i>{ z ' V) — 0- Hence, 

t t-i 

£ F(m)= Yl ^(flfi) = E Ev<Q%)^°- 

meM(X) y 1 ,...,y t £¥ j=l »li...,»t-i Vt 3=1 

where the last inequality follows as each of the terms in the outer summation is non- 
negative. 



3 If the circuit takes as input 0, we can first propagate it through the circuit and eliminate it. 
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The exponential sum estimate We now state an exponential sum estimate of Bourgain, 
Glibichuk, and Konyagin (see [BGK06],|Bo07]) that we will need later. The result is a 
special case of their result, and is similar to the version used in |RY08 1. 



Theorem 10. There exist two constants, an integer s G N and 7 > 0, such that for 
every prime p, for every family of sets A\, A2, ■ ■ ■ , A s C F2P of size at least 2 p / 20 each, 
for every nonzero z G F2P, and for each non-trivial additive character ip 0/F2P, 



y 1 £A 1 ,...,y s eA s 



<2-™\A 1 \.\A 2 



1-4, 



We use the above fixed s G N as the constant s in the construction of the polynomial F 
of Lemma |2 



A strengthening of the result of |RY08| We can prove, exactly along the lines of 
|RY08, Theorem 3.1], that the polynomial F has low correlation with 1/3-product 
polynomials. However, we need to prove the stronger claim that it has low correla- 
tion with Hadamard products of such polynomials. In order to prove this claim we need 
to strengthen DRY081 Theorem 3.1]. 

Let X = X' U X" be a partition of the variable set X. For a monomial m" G M(X"), 
we call the tuple (X 1 , X", to") a suitable restriction if for each i G [t] such that \X" H 
> p/2, some variable in X(i) appears in to". By our encoding assumption, this 
implies that for any monomial to' G Ai(X') and any i such that \X" (~l X(i)\ > p/2, 
yi (m'm")^0. 

Given a suitable [X',X", m"), denote by F the multilinear polynomial over the 
variables X' where, for any monomial to' S Ai(X'), F(m') = F(m'm"). Let 
/ = gh G C[X'] be a multilinear polynomial with g G C[A] and h G C[B], where 
A and B are disjoint sets. The required stronger version of |RY08 Theorem 3.1] is the 
following. 



Theorem 11. Assume {X 1 , X" , m") is suitable restriction. Let F be defined as above 
and let f — gh as above with \ A\, \B\ > n/10. Then, 

Corr(Pj)<™ 



2 Q i 

where the constant in the fi{-) is independent of f. 



Proof Sketch. Our notation is from [RY08]. For i G [t], let A(i) and B(i) denote 
A n X(i) and B n X(i) respectively. We need the following simple claim, the proof of 
which is similar to [RY08 Proposition 9.2], 
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Claim. There are at least s + 1 many i E [t] such that \A(i)\ > p/20 and at least s + 1 
many j £ [t] such that > p/20. 



Fix / C [i] of size s such that \A(i)\ > p/20 for each i E I. Let J = [i] \ /. By the 
above claim, there is a jo E J such that |-B(jo)| > p/20. 

Set = U ieJ #i = \J jeJ B(j) and A 2 = A\A X ,B 2 = B\Bx.We denote by 
ax, d{ etc. monomials from A4(Ai) and similarly for monomials from A4(A 2 ), M.(B\) 
and ^A/((i? 2 ). Finally, we denote by mi and m,2 the restriction of the monomial m" to 
the sets lj ig7 and (J - £ j X(j) respectively. 

Given monomials a 2 E .M(yl 2 ) and bx,b[ E Ai(Bi), denote by Z(a 2 ,bi,b' 1 ) the 
field element Yijej yj( a 2bim 2 ) — Yij^j yj( a ^i rn 2)- Let S(a 2 ) denote those pairs 
(bx,b[) such that Z(a 2 , bx, b[) = 0. Let Si = {a 2 \ \S{a 2 )\ > 2 2 \ b ^p/ 40 } and S 2 = 
{a 2 ||5(a 2 )|<2 2 l^l-f/ 40 }. 

The quantity we wish to bound is: 



Corr 



< 



^ -F(aia 2 &i& 2 )/(aia 2 6i& 2 ) 

ai,a 2 ,bi,b2 



^ F(aia 2 b 1 b2)f{aia2bib2) 

a 2 SSi 
01,61,62 



-F(aia 2 &i& 2 )/(aia 2 fei6 2 ) 



02GS2 

ai,6 1 ,b 2 



Ci 



c 2 



(3) 



We first bound C\ using the following analogue of |RY08 Corollary 9.6]. 



Claim. For large enough p, \Si \ < 2\ a ^-p/ 50 . 



Proof of Claim. Let S = {(a 2 , h, b'x) I Z(a 2 ,bx, b[) = 0}. We will bound \S\. For this 
we first bound the number of (a 2 ,6i,6' 1 ) such that Yije J Vi ( a 2b'im 2 ) = 0. 

Fix a j e J. If j is such that n X"\ > p/2 then, as {X',X",m") is a 

suitable restriction, we have yj(a 2 b' 1 m 2 ) ^ 0. Otherwise \X(j) D X'\ > p/2, and 
yj(a 2 b' 1 m 2 ) = only if none of the variables in X(j) n X' appears in a 2 or b\\ 
the number of such triples (a 2 ,6i,6 2 ) is at most 2l j42 l+ 2 l Sl l~ p / 2 . Thus, the number 
of (a 2 , bx,b{) such that n je j y ] (a2b' 1 m 2 ) = is at most £2I Ai I+ 2 I B2 I-p/ 2 . 
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If Tljzj yj(a 2 b' 1 m2) ^ then Z(a 2 , h,b 2 ) = only if 
y jo (a 2 b' 1 m2 



Y[ 3eJ y {a2bim 2 ) 



UjeJ\{j }yi( a 2 b 'i m 2)' 

I.e. the scalar yj (ci2b' 1 m2), and hence the restriction of b[ to Xj , is completely deter- 
mined by a 2 ,bi, and the restriction of b[ to X\Xj . Since \B(jo)\ > p/20, the number 
of (a 2 , fei, b[) such that this is true is at most 2^ A ^ +2 ^ Bl ^ p / 20 . Hence, 

151 < £2 |A2|+2|Bl| ~ p/2 + 2l j42 l +2 l- Bl l~ p / 20 < 2l A2 l+ 2 l- B il-p/ 20+1 

for large enough p. On the other hand, |5| is at least |5i| ■ 2 2 l Sl l _p / 40 . Hence, for large 
enough p we have 

< s < < 2 I j4i I-p/ 40 + 1 < 2l Al l~P/ 50 . 



It follows from the above claim, and a simple application of the Cauchy-Schwarz in- 
equality, that d < 2- f2 (")||F||||/||. Now we bound C 2 . In this case, the proof of 
|RY08 Proposition 9.4] goes through almost verbatim to yield the bound; the only 
change necessary is in the proof of [RY08 Claim 9.7], where we need to use the more 
general exponential sum estimate stated in Theorem [10] above. We omit this proof and 
simply state the obtained bound on C 2 . 

C 2 <2- n ^\\F\\\\f\\. 

Putting this together with Equation (fJJ) and the bound on C\ yields the statement of the 
theorem. ■ 



The correlation bound We now consider part 2 of Lemma Let f = ft ° f 2 be a 
Hadamard product of 1 /3-product polynomials /i and f 2 . Fori 6 {1,2}, let = gihi, 
where gi £ C[Ai], hi G C [.£?*]; Ai and Bi being disjoint subsets of X of size at least 
n/3 each. We can assume that Ai U Bi = X. Consider the four pairwise intersections 
Ai n A 2 , Ai n B 2 , A 2 n Si, and B x n B 2 . We can write any monomial m e M{X) 
as m,\\m,\ 2 m 2 \rn 22 , where mn,mi 2 ,m 2 i, and m 22 denote the restriction of m to 
A X C\ A 2 ,Air\B 2 ,A 2 r\ Bi, and B x n B 2 respectively. 

If A\ = A 2 and B\ = B 2 or A\ = B 2 and A 2 = B\, then the polynomial / is a 1/3- 
product polynomial. Following [RY08| we can show that F has very low correlation 
with all 1/3-product polynomials. Hence, in this easy case we are done. In the next 
claim we argue that an "approximate" version of this desirable scenario always holds. 

Claim. Let Ai, Bi, for i G {1, 2} be as defined above. At least one of the following 
holds. 

Case 1: \A X n A 2 \ > n/lOand \Bx D B 2 \ > n/10. 
Case 2: \A X n B 2 \ > n/10 and |A 2 nBij > n/10. 
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Proof of Claim. Assume Case 1 does not hold. Let us assume that \A\ CiA 2 \ < n/10(the 
other case is symmetric to this one). Then, since \A% \ > n/3, we know that \A 2 C[Bi | = 
I A2 1 — I A2 n Ai (this is because we have assumed that A\ U B\ = X), which is at least 
n/3 - n/10 > n/10. Similarly, \A\ H B 2 \ is also at least n/10. Thus, Case 2 holds. 

By swapping the names of A2 and B2 if necessary, we assume that Case 1 of claim [4] 

holds. Let X' = {A 1 D A 2 )U (B 1 D B 2 ) and X" = X\X' = (Ax n B 2 ) U (A 2 n £1). 

We now note that, restricted to the set of variables X', the polynomial / has a 'prod- 
uct polynomial structure'. More precisely, for a monomial m = m 11 m 12 m2im22 G 
.M(X), we can write f(m) as the product of gi(miimi 2 )g 2 (mnm 2 i) and 
h\(m 2 \m 22 )h 2 (m,\ 2 m, 22 )\ for a fixed 77742, m 2 i, the former depends only on the 
monomial inn and the latter only on 77122: this is very much like a product poly- 
nomial. We use this further below. From now, we denote by g\ 2 (m\\m\ 2 m 2 \) and 
h\ 2 {m\ 2 m 2 \m 22 ) the values g\(m\\m\ 2 )g 2 {m\\m 2 \) and h\(m 2 \m 22 )h 2 {m\ 2 m 22 ) . 
Hence, we have, 



Core (F J) 



^ F(m 11 m 12 m 21 m 22 )f(m 11 mi 2 m 2 im 22 ) 



mn,mi2,m2i,m22 



^ ^ F(miiTOi2TO2im22)gi2(TOllTOl2"^2l)^12(mi2m 2 im22) 

(4) 



mi2,m2i mn,m22 



For fixed m\ 2 and m2i, the inner summation above is the inner product of vectors that 
correspond to polynomials over the variables in X': one of the vectors is the restriction 
of F to these coordinates, and the other is the product g\ 2 h\ 2 , which is a 1/10-product 
polynomial over the variables in X' . Our aim is to show that, for 'most' values of m\ 2 
and m2i, the inner summation is small (to prove this, we will use the proof of |RY08 1); 
for other values of m\ 2 and 77721, a brute force bound will do. We show this first. 

Call a tuple of monomials (77712, 77721) € M.(A\ n B 2 ) x A4(A 2 fl5i)a suitable pair 
of monomials if the tuple is (X' , X" . m\ 2 m 2 \) is a suitable restriction as defined in 
the previous section. Let B denote the set {(77712,77721) € M.(A\ fl B 2 ) x Ai(A 2 D 
Bi) I (77112, m 2 i) not suitable} of unsuitable pairs of monomials, and let £>' denote the 
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set of suitable pairs of monomials. We split the summation in Equation © as follows: 

Corr(F, /)< ^ F ( m ii m i2m2irn22)gi2(mi 1 m 1 2m2i)h 1 2{m 12 rn2im22) 

(m 12 ,m 21 )£B mn,m 22 



Ti 



^ F(m 11 m 1 2m2im22)gi2(m 11 m 1 2m2i)h 1 2(m 1 2m2im 2 2) 

{m 12 ,m 21 )eB' mn,m 2 2 



T 2 

(5) 



We bound the sums T\ and T2 separately. We tackle T\ first. We need a claim bounding 
the number of unsuitable pairs: 

\x" I 

Claim. I S| < |77^y, for large enough n. 

Proof of Claim. Let S C [i] be the set of those i s.t \X(i) H X"| > p/2. For i e 5, let 
Bi denote those pairs of monomials (mi2, m.21) € -M(^4i (~l -B2) x M-{^2 fl -Bi) such 
that no variable 1 £ fl X" appears in them. 

Clearly, fori G S, \Bi\ < 2\ x "\ x ^\ < 2\ x "\- p/2 . Also, since B = \J ieS Bi, we 

have \B\ < |S'|2l x "|- p/2 < t2\ x "\- p/2 . Since p = n/t = Q(n), we see that \B\ < 
2 \x"\ / / 2 ^(n) ; for i arge enough n. 

We now bound T\ . Using the Cauchy-Schwarz inequality, we have, 



Tl< ^2 ^2 l^( TO ll TO 12'^2l"l22)r 

V (mi 2 ,m 2 i)eBmu,m22 



/ ^2 ^2 \9i2(rn 11 m 1 2rn2i)hi2(mi2rn2im 2 2) 

(mi2,m 2 i)SB m 11 ,m 2 2 



<y\B\2\ x "\ ^2 |gi2(miimi2m2i)/ii2(TOi2m 2 iTO22) 



"112, "121, "111, "122 



< 2 j£ ^- fl W |/(m)| 2 < Jg.ll/ll = 2- fi (")||^||||/|| (6) 



Above, we have used the fact that |.F(m)| = 1 for all monomials m, and that for 

in = m 11 mi27n2im22, f(m) = S , i2(mnmi2m2i)/ii2(mi2m2im 2 2). 
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We now bound T%. Fix any suitable pair of monomials (mi2, m 2 i). For ran £ (Ai n 
A2) and TO22 S .M(-Bi fl B 2 ), we denote by F(miim2 2 ), <?(ran) and h{m22) the val- 
ues F(TOnmi2TO2iTO 2 2), gi2{mi 1 mi 2 m2i), and /ii 2 (mi2ro2im 2 2) respectively. We 
think of F, and ft, as vectors of multilinear polynomials over X'. Looked at in this 
way, g G C[A 1 nA 2 ] and h e C[S x nS 2 ]. ByClaimg] |A X nA 2 |, |Bi nB 2 | > n/10. 
Hence, Theorem[TT]is applicable, and we have 



Corr 



(7) 



Using the above bound, we bound T 2 and finish the proof of Lemma|2] 



Squaring the expression for T 2 in Equation|5] and using the Cauchy-Schwarz inequality, 
we have, 



T 2 < \B'\ ^2 X! F { m ii m i2rn 2 im 22 )gi 2 {miimi 2 m 2 i)hi 2 {mi 2 m 2 im 22 ) 

(roi2,ro2i)£B' m 11 ,m 2 2 

< \B'\ 2\ x ^2 ^2 \9i2(miim 12 m 21 )h 12 (m 12 m 21 m 22 )\ 2 (by Equation Q 

< 2 |x»|+|x'|-«W £ £ |/(mum 12 m 2im22 )| 2 (v < 2 M) 

(mi2,m2l)eB' mil, "122 

< 2 »-n( n ) £ |/(m)| 2 < |3J||/|| 2 . (smce||F|| 2 = 2™) 

meA4(X) 

.•.T 2 <2- fi (")||F||||/||. 

Using the above bound on T 2 , and Equations [4] and |6j we see that 

Corr(F,/)<T 1+ T2<2- r2 (")||F||||/||. 
This proves part 2 of Lemma[2] 
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